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Abstract. The human operator is, no doubt, the most complex and variable 
element of a Mechatronics system. On simpler manual control tasks, a linear 
model may be used to capture the human dynamics, however experiences on 
human operator response during pursuit manual tracking tasks, show that the 
dynamics of the human operator appear to depend on the specific task that the 
subject is asked to perform. This means that a unique truly human model 
cannot be completely achieved. Rather, a different set of models, each for a 
certain class of task, seems to be needed. This ongoing PhD work introduces 
several approaches on the human operator dynamic characteristic modeling 
and identification procedures, which may be useful for developing improved 
"humetronic" systems, i.e. human-machine systems which may be able to 
adapt themselves to the skill level of humans, aiming, with reduced effort, to 
achieve for best performance and safety. 

Keywords: Human Dynamics Modeling, Identification, Human-Machine 
Interfaces, Manual Tracking Systems, Machine Adaptation. 


1 Introduction 

Nowadays we rely on many different mechatronics equipments and gadgets for 
carrying out our way of life, and we are well aware of the limitations with which 
machines can efficiently perform controlled manual tasks, because unfortunately 
these machines usually do not change regardless of the human operator's skill. 

Current research aimed to improve performance and safety on man-machine 
systems is increasing. In an ordinary human-machine interface the human operator 
controls the machine hy performing various manual control tasks. While performing 
the activity the operator is also learning it, and its skill is increasing. Hence, it seems 
natural the need for designing human-oriented machines which, in a smart way, may 
improve the assistance and performance with its human users. 
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1.1 Automatic Control versus Human-in-the-Loop (HIL) Control 

Automatic control applications usually do not consider that the human factor 
inevitably belongs into the resulting closed-loop, and in an automatic control process 
human is still often considered remissness. 

Human-in-the-loop (HIL) control is a starting approach to integrate the human 
model into the already assortment of electrical and mechanical factors involved in a 
closed-loop man-machine control design. 



Fig. 1. a) Human-machine system block diagram. Comparison between automatic b) and 
human-in-the-loop control c). 


1.2 The Human Adaptive Mechatronics (HAM) Assist Control Concept 

An important goal today is to improve the design of next generation adaptive 
human-oriented machines, which will have the ability to intelligently cooperate with 
its human users. These machines should be able to actively adapt according to the 
skills of their operators, being capable to evaluate human’s global performance. A 
human adaptive mechatronics assist control system [1], [2], [3] identifies the 
operator based on his acquired actions in the process, and an assist controller is then 
iteratively conceived to improve the operator’s performance according to its skill. 



Fig. 2. Human adaptive mechatronics assist control block diagram. 

Fig. 2 shows a HAM assist control application example [4], where the machine 
dynamics is settled by tuning its virtual model from previously estimation of 
human's skill. 

1.3 Modeling Human Behavior 

Human models are important to design a machine system to be controlled by an 
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operator. The model is not aimed to closely replicate the operator behavior, but to 
provide sufficient information for the design of closed-loop control system 
incorporating the human behavior. Thus, in spite the fact that humans are non-linear 
time-varying complex systems, linear models are used as a way to capture some of 
the relevant characteristics of the human operator. This allows the use of standard 
control design techniques, combined with supervisionary controls approaches to 
tackle non-linearity and time variations. 

To obtain linear models a number of experiments is required. Such experiments 
must be designed so as to minimize undesired effects like operator learning and 
prediction of the task or action signal saturation. 

The first studies in human modeling were inspired by the demand for pilot 
models during the Second World War, and since that time there had been made 
many experiments, especially in pursuit and compensatory manual tracking tasks. 
One of the earliest studies of the human operator acting as a linear servomechanism 
was done in 1947 by Tustin, who proposed that there might be a linear law that 
could represent most of the operator's behavior. More recently new identification 
theories, methods and tools became available, striving human modeling to achieve 
significant progress. 

In this paper several approaches are introduced on the human dynamic modeling 
and identification methods, and experimental procedures, for developing new 
human-oriented machines, which aim for best performance and safety, reducing also 
operator's effort. Although it must be stressed that whatever approach is taken to the 
description of human behavior, it only will capture a fraction of it, as human 
operator comprises the complex element in a man-machine system. 


2 Contribution to Sustainability 

Human-oriented machines help to create more sustainable services and products, 
without compromising human and environmental safety, as we are all challenged to 
produce and recycle more with fewer resources. 

Essentially, three necessary phases are required for designing HAM systems: 

1) Estimate human control characteristics; 

2) Quantify the overall skill; 

3) Design the assist-control human-machine system. 

The first phase can be considered both as a signal processing and a system 
identification problem, which implies developing theoretical and experimental 
procedures for obtaining the human controller from measured response data. On 
simpler manual control tasks a linear model can capture relatively well the human's 
behavior*. However, the model depends on the task and the process to be controlled, 
and simultaneously on many other factors, both personal and environmental, such as 
concentration, training, disturbances, comfort, workload, saturation, intermittency, 
fatigue, etc. The second phase for HAM design uses the experimental data obtained 
to quantify the overall operator skill, by comparing between an individual and its 


* The Crossover and the Proportional Derivative are generalized low order linear 
human models, well described in the literature. 
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ideal response. Comparing ideal and identified parameters can also provide more 
accurate skill quantification. Next, according to the skill level obtained, an assist- 
control system (which is able to change the "amount of assistance") is finally 
implemented, based on an ideal model and on the acquired skill data. 

In this work special focus is given on the first step of the Human Adaptive 
Mechatronics project, i.e. on the methods and procedures that can be derived for 
estimating the human control characteristics. We propose that the systemic notion of 
task dependence must be employed to model a human-machine system. New 
schemes for deriving task-dependent characteristics are explored though 
nonparametric and parametric identification methods. 

Different approaches to the human identification problem are presented: we 
started by transient analysis (impulse and step response), obtained from pursuit 
manual tracking experiments. A special method to estimate the operator’s delay¬ 
time was investigated. Structured Auto Regressive with exogenous (ARX) input- 
output data parametric models where employed to obtain human-machine linear 
models from manual 1-D tracking experiences. Finally, the improved frequency 
analysis method is described in detail for modeling operator dynamics. An 
experimental setup that allowed the implementation of a human operator control 
task has also been developed, implemented and tested. The experimental procedures 
deployed for estimating the human-machine dynamics had an important role in this 
work, and where also described in detail. 


3 State-of-the-Art / Related Literature 

There have been in the past many studies covering the human operator dynamics 
modeling, especially within aeronautical engineering and flight control systems. 
Since the late 1940’s that many experiments of human pilots performing target 
tracking tasks where studied. Important theories have been first introduced by 
McRuer et al., for manual tracking tasks using random references. A quasi-linear 
model was developed for describing human behavior during compensatory tracking 
tasks. In the 1960s and the 1970s modeling the human controller made great 
progresses [5]. The McRuer's et al. linear crossover model [6] and the optimal 
control model of Baron and Kleinman (applied for compensatory tracking) where 
proposed. The Baron's optimal control model was further developed by Tomizuka 
for preview tracking. In 1974 Shinners proposed the use of ARMA (autoregressive 
moving-average) models, obtained from tracking tasks. 

In the 1990s Kawato postulated that the human's control has feedback and 
feedforward structures, and through the process of learning he changes from 
feedback to feedfoward (in the Feedback Error Learning model [7] the cerebellum 
acquires a model of the machine, as an inverse model in the feedforward path). 
Wolpert and Kawato improved the Feedback Error Learning model to a module 
selection and identification control (MOSAIC) [8], expanding the inverse model into 
a controller and the forward model into a predictor. Latest developments include 
using optimal control model (OCM) design techniques (by minimizing a certain 
performance index), assuming that the human operator performs the manual task in 
an optimal way. Particle swarm optimization (PSO) is a promising method for 
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obtaining the OCM parameters from experimental data. ARX models (linear 
approach) and adaptive-network-hased fuzzy inference tools have been recently 
studied. A new hybrid fuzzy-ARX modeling method [9] has also been recently 
developed for predicting the human operator control actions. 


4 Research Contribution and Innovation 

This work introduces several methodologies on the human-machine dynamic 
modeling and identification procedures, which can be applied on the development of 
improved HAM systems. In general, for execution of complicated tasks the human 
response does not follow linear behavior. However, for simpler servo/regulator 
control tasks, a linear model can be employed to capture most of the operator’s 
dynamic characteristics. 

Linear models can be obtained by physical (mathematical) modeling, and through 
system identification techniques based on measured data. The first approach is rather 
involved and time consuming, lying far beyond the objectives in hand. Hence, this 
work is focused on the system identification problem, i.e., on how to estimate a 
human-machine system model from the observed input/output data. Parametric 
identification methods are techniques to estimate parameters for pre-defmed model 
structures, by finding through numerical search the parameters values that minimize 
the differences between the model’s output and the measured data. ARX parametric 
identification methods were used in this work to model the human-machine 
dynamics. Nonparametric identification methods allow obtaining the operator 
behavior without the need for a pre-defmed parameterized model structure. We have 
employed also nonparametric methods in this work, by analyzing the human 
operator transient and Ifequency responses on manual tracking tasks. 

4.1 ARX Model Estimation 

Auto-Regressive with exogenous terms (ARX) models are well suited for modeling 
linear systems, due to its high potential and simplicity. The most common ARX 
structure is the linear difference equation: 

y(t) + a^y(t-l) + ... + a^^y(t-na) = b^u(t-nk) + ...b^^u(t-nk-nb + l) . (1) 

The present output y{t) is related to a number of past inputs u{t-k) and past outputs 
yit-k). na equals the number of poles and nb the number of zeros, nk is the time 
delay inherent to the system. Typical estimation methods used for obtaining a and b 
parameters are the least-squares, the Kalman filter, and the instrumental variable 
method. 

4.2 Transient Response Analysis 

The dynamic properties of a linear model can be investigated by analyzing its 
transient response. For example, system time delays, time constants and static gain 
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can be computed through the obtained impulse and step responses. Also, the right 
previous selection of the delay nk in the ARX model structure may he crucial for 
obtaining good identification results. Finally, the identification of low order linear 
models can also be easily confirmed from transient (step and impulse) analysis 
experiments. 

4.3 Time-delay Estimation 

Time-delay [10] is an important human factor that affects operator performance. 
Although human is considered a nonlinear system, many studies (such as proposed 
by Ragazzini) support that in a simple motor task the operator behavior can be 
sufficiently identified by a linear model plus a finite time-delay (as a result of the 
neuromuscular and central nervous latencies, and also due to other human dependent 
and environmental factors). The time-delay parameter is inherent to the ARX 
method, through the sampling shift. Therefore, human operator time-delay 
estimation can be further confirmed throughout the ARX identification procedure. 


4.4 The Improved Frequency Analysis Method 

Another nonparametric identification method is based on the frequency response, 
i.e. on how a linear dynamic model would react to certain sinusoidal inputs. In a LTI 
system, if we let the input u{t) be a sinusoid of a certain frequency, then the output 
y{t) will also be a sinusoid of the same frequency. However, the amplitude and the 
phase may be different. If we consider a one-dimensional normalized input signal of 
duration T, to be tracked, x(t), built from a sum of N sinusoids at fixed multiple 
frequencies, the correspondent output y(t) and the I/O response for each frequency 
may be obtained through the following diagram: 


N 

k=i k=l 

ycAO 


N 

I 

k=l 





ysAO 


Fig. 3. Frequency analysis block diagram for each k-multiple frequency. 

klTT 

By performing the integration along time T =- (a multiple of the sinusoid 

0 ) 

period,), results in: 

T Jj j' 

sin(<J4/ + <Pi,) cos cOjtdt y^^ (T) = -|-sin (p^ 


(4,5) 

(6,7) 

( 8 ) 
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T Jy J' 

(T) = [ b,^ sin((J4? + <1=^ {T) = -^cos 

t J k i 

^k=Y^yc,^iT) + y^^^{T) and ^3^=arctan 

y » / 

which corresponds to the resulting human-machine closed-loop frequency response 
and static gainA',, (for a previous input offset Xq). From the closed-loop 
experimental data, an open-loop human-machine model can he obtained, hy inverse 
manipulation. 


yc^n 

ys,.(T) 




5 Discussion of Results and Critical View 

This section presents obtained results from the experiments that where conduced for 
estimating human-machine models, in 1-D pursuit manual tracking tasks. 


5.1 Experimental Procedures 


For the transient analysis, two sets of five tracking samples (each lasted 2 minutes, 
and with at least 6 steps/impulses) were performed for a same operator with no 
history of neurological disease. To ensure human memorization or fatigue does not 
influence results, a minimum 15 minute rest was imposed between trials. The 
impulse and step inputs were visually recognized through large led indicators. In 
concerning ARX modeling, a set of four tracking tasks where conduced, with 7=120 
seconds duration each, comprising a white noise low-pass filtered input 

signal. 


1 

0.5 

Normalized 
Position 0 

-0.5 

-1 

0 2 4 6 8 102141618 20 

Time (s) 

Fig. 4. A manual tracking time-trial using Logitech's Extreme 3D Pro. 8-bit analog Joystick. 




His) = 


25 

s^+l.Qins + 25 


(9) 


To obtain a human-machine linear model from the experimental data, a procedure 
was proposed. In system identification the adequate choice of the sampling rate is 
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important. Sampling to fast leads to poor modeling. However, the use of an incorrect 
value for pure time-delay can mask system behavior. So the procedure to choose 
both time-delay and sample rate is as follows: 

1. The signals are oversampled, at 100 Hz. 

2. The first 0.5 seconds of each test are discarded because it corresponds to the 
low-pass filter initial transient. 

3. For each choice for time-delay the signals are decimated before an ARX 
model is computed. From the point of view of discrete time models this 
corresponds to non-integer delay. 

4. Taking the quadratic deviation between the true output and its estimated 
value as a performance index, the best combination for (time-delay, sampling 
rate, model structure) is chosen. 

5. Continuous time equivalents of the time-delay and ARX model are 
separately obtained, and combined into a single continuous time model. 

Frequency analysis experimental procedures and results fall beyond the size of 
this paper, and were already described in detail in previous work [11], [12]. 


5.2 Experimental Results 

Obtained step and impulse response data showed that pure time-delay is unrelated 
with the number of trials (or human experience). Hence, for the identification of the 
operator’s behavior a simple compensation data shift can be included in the 
correspondent model. Saturation and nonlinearity characteristics can also be found 
at the maximum limits, and near the joystick’s origin, and the impulse tests where 
made with a 0.2 offset, to avoid the mechanical nonlinearities near the origin. 




0.5 1 

Time (s) 

Fig. 5. Step (lefi) and impulse (right) responses, at lOOHz sampling rate. 
Table 1. Pure time-delay (in seconds), on five manual tracking step and impulse tasks. 
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delay 
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1 - 10 

0.43 

0.37 

0.36 

0.39 

0.41 

0.46 

0.39 

0.42 

0.38 

0.51 

11-20 

0.57 

0.43 

0.41 

0.40 

0.46 

0.45 

0.44 

0.41 

0.42 

0.58 

21-30 

0.44 

0.41 

0.46 

0.46 

0.44 

0.49 

0.54 

0.39 

- 

- 

Step 





delay 

(s) 





1 - 10 

0.43 

0.42 

0.45 

0.45 

0.46 

0.4 

0.4 

0.42 

0.42 

0.42 

11-20 

0.41 

0.39 

0.44 

0.46 

0.47 

0.44 

0.42 

0.37 

0.43 

0.51 

21-30 

0.34 

0.52 

0.5 

0.43 

0.4 

0.58 

0.39 

0.45 

0.49 

0.41 
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As for ARX modeling, the best fit corresponds to the model: 

^ 61.42^^ -1.586004/ -3.483e0055" -1.7856006^" 

~ / +116/ +5730/ +1.691e005/ +3.198e006/ +4.197e007/ 
+3.243e0075^ +5.992e0085" +3.584e0095 + 4.209e009 
' +3.656e008s' + 2.132e0095' +7.016e0095 + 6.316e009 




Fig. 6. ARX-980 model validation {left) on a manual tracking sample {first 20 seconds). 
Magnitude Bode plot for the human-machine ARX-980 model shucture {right). 


The human-machine estimated time-delay is 280 ms, while the average time- 
delay obtained from the impulse and step analysis was, respectively, 440 ms and 437 
ms. 

Although impulse response analysis is a simple and fast open-loop experimental 
method, it has some disadvantages, due to augmented saturation, nonlinearities and 
human fatigue. Step response analysis confirmed the same time-delay values that 
were obtained in the impulse response experiments. These methods, along with 
ARX model estimation are still limited modeling techniques, which need additional 
validation. Frequency analysis can be used to obtain an accurate open-loop LTI 
model, from a sum of sinusoidal input signals. It is a closed-loop experimental 
method. Hence, to capture the relevant human-machine dynamic characteristics, the 
obtained models need to be converted to open-loop ones. 


6 Conclusions and Further Work 

This work investigated the linear modeling methods potential for identifying the 
human-machine controller characteristics, as required for the design of Human 
Adaptive Mechatronics (HAM) systems. 

An experimental human-machine Lab VIEW interface setup has been developed 
and implemented for collecting data from human operators, as they performed 
pursuit manual tracking tasks with an analog joystick. As confirmed in previous 
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work, these obtained models depend on the type and shape of the input tracking 
signal (the same occurs with the estimated time-delay). It was also verified that the 
time-delay characteristic (for a same individual) is almost constant regardless the 
skill level or experience. Hence, pure time-delay can be detached for identification 
purposes. 

For future work, and to be even more applicable, the linear identification methods 
described should be also accomplished from real-time collected task execution data. 
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